sooner the better, the

As quickly or early as possible, as in As for stopping that check, the sooner the better. This idiom was first recorded in 1477.